Express Mail Label: EL 982792127 US 
Dote of Deposit: November 26, 2003 

Classification of Image Blocks by Region Contrast Significance and Uses Therefor 
in Selective Image Enhancement in Video and Image Coding. 

FIELD OF THE INVENTION 
The present invention relates to compression of video image data and 
optimization thereof. 

BACKGROUND OF THE INVENTION 

Exploiting characteristics of the Human Visual System (HVS) for the 
compression of video and still images is a field of active interest in video compression 
research. Several factors of varying significance have been discovered to influence 
human visual attention, such as motion, contrast, image element size, etc., and various 
techniques have been developed that attempt to define those regions in an image that are 
of greatest significance, such as those to which himian visual attention is most sensitive. 
This significance information is then used to affect the compression of video/still images 
in a way that enhances the viewing quality of more significant regions. While this may 
be accomplished by using lower DOT quantizer values for more perceptually significant 
blocks, not all encoding standards support flexible altemation of the quantizer at the 
block or macroblock level. 

HVS-significant image regions are particularly sensitive to distortions 
introduced by damaged or lost data and error propagation. In MPEG encoding, I-fi^es 
(INTRA-fi-ames), in which complete image fi-ames are encoded, are followed by one or 
more P-fi-ames (INTER-fi-ames) in which the difference between the current image fi-ame 
and a previous image frame is encoded. To prevent error propagation among the P- 
firames until the next I-fi:ame is reached, portions of the P-fi-ames known as INTRA 
blocks are encoded as-is, without respect to previous fi-ames. While various techniques 
for the spatial positioning of INTRA blocks within P-frames for error-resiUent video 
encoding have been suggested, these techniques do not adequately take in account the 
mechanisms of the Human Visual System. 
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A technique for determining image block significance in terms of the Human 
Visual System that may then be adapted for optimizing standard encoding techniques 
with little or no increase in encoding/decoding overhead would therefore be 
advantageous. 

SUMMARY OF THE INVENTION 

The present invention provides for determining image sub-area significance 
based on region contrast and employing sub-area significance for optimized encoding. A 
new region contrast significance measure C(B) is introduced for image sub-areas B of 
predefined size and shape, such as 8x8 pixel image blocks, where C(B) may be defined to 
be proportional to the number of the first partition in a sequence of region merging 
partitions which covers B to the extent of a predefined coverage measure, such as 
complete coverage. Methods and apparatus are disclosed for the computation of C(B); 
for using the introduced measure for selective image enhancement in image/video 
compression by truncating the DCT coefficients or alternating the quantizer values; for 
error-resilient video encoding that gives preference for INTRA-mode encoding to the 
areas B with high values of C(B); and for error-resilient video encoding that gives 
preference for INTRA-mode encoding to the areas B which include pixels from different 
image regions obtained as the result of segmenting the image using conventional 
segmentation techniques. , 

In one aspect of the present invention a method is provided for determining 
image block significance based on region contrast, the method including a) partitioning 
an image frame into multiple pixel regions of at least one pixel each, b) pairing any of the 
regions with an unpaired, adjoining region, c) calculating a similarity value between each 
region in any of the region pairs, d) merging paired regions of any of the pairs into a 
single region, where the region pair to be merged has a predefined similarity value, 
thereby creating a new partition of the image frame into multiple pixel regions, e) 
performing stq)s a) - d) a plxirality of times, thereby obtaining a sequence of image 
partitions, f) selecting within the image frame an image sub-area of a predefined size and 
shape, g) identifying a partition in the sequence of partitions in which the image sub-area 
is covered by any of the regions to the extent of a predefined coverage measure, and h) 
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calculating a region contrast significance value C(B) of the image sub-area as a value 
which is proportional to the position of the identified partition in the sequence of 
partitions. 

In another aspect of the present invention the calculating step c) includes 
calculating the contrast between any of the pairs. 

In another aspect of the present invention the calculating step c) includes 
calculating the average luminescence of the pixels in one region in any of the pairs, and 
subtracting the average luminescence firom the average luminescence of the pixels in the 
other region in the pair. 

In another aspect of the present invention the merging step d) includes 
merging where the region pair to be merged has a predefined similarity value 
representing the least absolute contrast of any of the pairs. 

In another aspect of the present invention the performing step e) includes 
performing until a predefined number of regions is achieved. 

In another aspect of the present invention the performing step e) includes 
performing until the similarity value reaches a predefined threshold value. 

In another aspect of the present invention the performing step e) includes 
performing until a predefined stop condition is met. 

In another aspect of the present invention the selecting step f) includes 
selecting an 8x8 pixel block. 

In another aspect of the present invention the identifying step g) includes 
identifying the first partition in the sequence of partitions in which the image sub-area is 
covered by any of the regions to the extent of the predefined coverage measure. 

In another aspect of the present invention the identifying step g) includes 
identifying the partition in the sequence of partitions in which the image sub-area is 
completely covered by any of the regions. 

In another aspect of the present invention the identifying step g) includes 
identifying the first partition in the sequence of partitions in which the image sub-area is 
completely covered by any of the regions. 

In another aspect of the present invention any of the steps are performed on 
either of a JPEG image and an MPEG video fi-ame. 
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In another aspect of the present invention a method is provided for encoding 
image sub-areas, the method including a) partitioning an image frame into multiple pixel 
regions of at least one pixel each, b) pairing any of the regions with an unpaired, 
adjoining region, c) calculating a similarity value between each region in any of the 
region pairs, d) merging paired regions of any of the pairs into a single region, where the 
region pair to be merged has a predefined similarity value, thereby creating a new 
partition of the image frame into multiple pixel regions, e) performing steps a) - d) a 
plurality of times, thereby obtaining a sequence of image partitions, f) selecting within 
the image firame an image sub-area of a predefined size and shape, g) identifying a 
partition in the sequence of partitions in which the image sub-area is covered by any of 
the regions to the extent of a predefined coverage measure, h) calculating a region 
contrast significance value of the image sub-area as a value which is proportional to the 
position of the identified partition in the sequence of partitions, and i) designating the 
image sub-area for enhanced encoding by a video encoder where the significance value 
meets a predefined criterion. 

In another aspect of the present invention any of the steps are performed on 
either of a JPEG image and an MPEG video frame. 

In another aspect of the present invention the designating step includes 
designating where the significance value is at or above a predetermined threshold. 

In another aspect of the present invention the designating step includes 
quantizing DCT coefficients of the image sub-area using lower quantizer values than for 
another image sub-area whose significance value is below the predetermined threshold. 

In another aspect of the present invention the designating step includes 
scanning DCT coefficients of the image sub-area in accordance with a predefined 
scanning pattem, and halting the scanning when L(B) of the DCT coefficients have been 
scanned, where L(B) = 64 if C(B)>=T, and where L(B) = kx C(B) otherwise, where T is a 
predefined significance threshold and ^ is a predefined scaling factor. 

In another aspect of the present invention the designating step includes 
scanning DCT coefficients of the image sub-area in accordance with a predefined 
scanning pattem, and quantizing any of the DCT coefficients located at an z-th position of 
the scanning pattem using a quantizer value as P(i) (M-k* C(B) )^ where P(i) is a value 
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of a qxiantization pattern for i-th position of the scanning pattern, where M is a 
quantization threshold, and where A: is a predefined scaling factor. 

In another aspect of the present invention the designating step includes 
determining that the image sub-area is to be encoded in INTRA encoding mode where the 
significance value meets the predefined criterion. 

In another aspect of the present invention the designating step includes 
determining that the image sub-area is to be encoded in INTRA encoding mode if the 
image sub-area has a significance value at or above a predetermined threshold. 

In another aspect of the present invention the designating step includes 
determining that the image sub-area is to be encoded as the difference between the sub- 
area and a sub-area in another fi-ame if the first sub-area has a significance value below 
the threshold. 

In another aspect of the present invention a method is provided for encoding 
image sub-areas, the method including segmenting an image into a plurality of regions, 
and encoding an image sub-area of an INTER-firame as an INTRA block where the image 
sub-area contains pixels fi-om at least two of the regions. 

In another aspect of the present invention apparatus is provided for encoding 
image sub-areas according to their significance, including a video encoder, and a 
computation module operative to a) partition an image fi'ame into multiple pixel regions 
of at least one pixel each, b) pair any of the regions with an unpaired, adjoining region, c) 
calculate a similarity value between each region in any of the region pairs, d) merge 
paired regions of any of the pairs into a single region, where the region pair to be merged 
has a predefined similarity value, thereby creating a new partition of the image frame into 
multiple pixel regions, e) perform steps a) - d) a plurality of times, thereby obtaining a 
sequence of image partitions, f) select within the image frame an image sub-area of a 
predefined size and shape, g) identify a partition in the sequence of partitions in which 
the image sub-area is covered by any of the regions to the extent of a predefined coverage 
measure, h) calculate a region contrast significance value of the image sub-area as a value 
which is proportional to the position of the identified partition in the sequence of 
• partitions, and i) designate the image sub-area for enhanced encoding by the video 
encoder where the significance value meets a predefined criterion. 
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In another aspect of the present invention the computation module is 
operative to process either of a JPEG image and an MPEG video frame. 

In another aspect of the present invention the computation module is 
operative to designate the image sub-area for enhanced encoding where the significance 
value is at or above a predetermined threshold. 

In another aspect of the present invention the computation module is 
operative to quantize DCT coefficients of the image sub-area using lower quantizer 
values tiian for another image sub-area whose significance value is below the 
predetermined threshold. 

In another aspect of the present invention the computation module is 
operative to scan DCT coefficients of the image sub-area in accordance with a predefined 
scanning pattern, and halt the scanning when L(B) of the DCT coefficients have been 
scanned, where L(B) = 64 if C(B)>=T^ and where L(B) = kx C(B) otherwise, where Tis a 
predefined significance threshold and ^ is a predefined scaling factor. 

In another aspect of the present invention the computation module is 
operative to scan DCT coefficients of the image sub-area in accordance with a predefined 
scanning pattem, and quantize any of the DCT coefficients located at an f-th position of 
the scanning pattern using a quantizer value as P(i) * (21/ -A: * C(B) ), where P(i) is a value 
of a quantization pattern for z-th position of the scanning pattern, where M is a 
quantization threshold, and where ^ is a predefined scaling factor. 

In another aspect of the present invention the computation module is 
operative to determine that the image sub-area is to be encoded in INTRA encoding mode 
where the significance value meets the predefined criterion. 

In another aspect of the present invention the computation module is 
operative to determine that the image sub-area is to be encoded in INTRA encoding mode 
if the image sub-area has a significance value at or above a predetermined threshold. 

In another aspect of the present invention the computation module is 
operative to determine that the image sub-area is to be encoded as the difference between 
the sub-area and a sub-area in another frame if the first sub-area has a significance value 
below the threshold. 
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In another aspect of the present invention a computer program is provided 
embodied on a computer-readable medium, the computer program including a &st code 
segment operative to partition an image frame into multiple pixel regions of at least one 
pixel each, a second code segment operative to pair any of the regions with an unpaired, 
adjoining region, a third code segment operative to calculate a similarity value between 
each region in any of the region pairs, a fourth code segment operative to merge paired 
regions of any of the pairs into a single region, where the region pair to be merged has a 
predefined similarity value, thereby creating a new partition of the image frame into 
multiple pixel regions, a fifth code segment operative to perform steps a) - d) a plurality 
of times, thereby obtaining a sequence of image partitions, a sixth code segment 
operative to select within the image frame an image sub-area of a predefined size and 
shape, a seventh code segment operative to identify a partition in the sequence of 
partitions in which the image sub-area is covered by any of the regions to the extent of a 
predefined coverage measure, and a eighth code segment operative to calculate a region 
contrast significance value of the image sub-area as a value which is proportional to the 
position of the identified partition in the sequence of partitions. 

In another aspect of the present invention the computer program further 
includes a ninth code segment operative to designate the image sub-area for enhanced 
encoding by the video encoder where the significance value meets a predefined criterion. 

It is appreciated throughout the specification and claims that methods and 
apparatus described herein with respect to images may be applied to individual video 
frames, and vice versa. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention will be understood and appreciated more fully from the 

following detailed description taken in conjunction with the appended drawings in which: 
Fig. lA is a simplified flowchart illustration of a method for determining 

image sub-area significance, operative in accordance with a preferred embodiment of the 

present invention; 

Fig. IB is a simplified pictorial illustration of merged regions, useful in 
xmderstanding the present invention; 
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Figs. 2A - 2B, 3 A - 3B and 4A - 4B are sample video frames processed in 
accordance with a preferred embodiment of the present invention; 

Fig. 5 is a simplified block diagram of a video encoder adapted for encoding 
image sub-areas according to their significance, constructed and operative in accordance 
with a preferred embodiment of the present invention; 

Fig. 6 is a simplified flowchart illustration of a method for selecting image 
sub-areas for INTRA encoding according to their significance, operative in accordance 
with a preferred embodiment of the present invention; 

Fig. 7 is a simplified flowchart illustration of a method for selecting image 
sub-areas for INTRA encoding according to their significance, operative in accordance 
with a preferred embodiment of the present invention; 

Fig. 8 is a simplified graphical illustration of image blocks of different 
expected contrast significance, usefiil in understanding the present invention; 

Fig. 9 is a simpUfied block diagram of a video encoder adapted for encoding 
image sub-areas according to their significance, constructed and operative in accordance 
with a preferred embodiment of the present invention; 

Fig. 10 is a simplified flowchart illustration of a method for selecting image 
sub-areas for INTRA encoding according to their significance, operative in accordance 
with a preferred embodiment of the present invention; and 

Fig. 1 1 is a simplified flowchart illustration of a method for scanning of the 
DCT coefficients of image sub-areas according to their significance, operative in 
accordance with a preferred embodiment of the present invention; 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Reference is now made to Fig. 1 A, which is a simplified flowchart illustration 
of a method for determining image sub-area significance, operative in accordance with a 
preferred embodiment of the present invention. In the method of Fig. 1 A, an image is 
partitioned into multiple pixel regions of one or more pixels each. Typically, each region 
initially consists of one pixel. A similarity value for pairs of adjoining regions in the 
image, and preferably between each pair of adjoining regions in the image, is then 
calculated. For example, the similarity value may be the contrast between pairs of 
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adjoining regions in the image, and may be calculated using any contrast measurement 
technique, such as where the average luminescence of the pixels in one region may be 
calculated and subtracted from the average luminescence of the pixels in an adjoining 
region. A region pair having a predefined similarity value, such as the greatest similarity 
value of all region pairs, which, if the similarity value represents contrast, represents the 
region pair with the least absolute contrast, is then merged into a single region, and the 
new merged region is then again compared to its adjoining regions. In this manner, 
region pairing and merging of regions of predefined similarity value may continue until a 
predefined stop condition is met. For example, region pairing and merging may continue 
until a predefined nxmiber of regions is achieved, such as one region (i.e., the entire 
original image). Alternatively, region pairing and merging may continue until the 
predefined similarity value between paired regions reaches a predefined threshold value. 

Region merging (RM) as described herein for a given image may start with a 
partition P(l) having a single pixel and teraiinate with a partition P(N) comprising the 
entire image where: 

itA/=P(l),P(2),...,P(iV) EQ.l 
Each partition P(n +1) may be obtained firom the previous P(n) by merging two regions 
V\(n), V2(n) such that 

(Vi(n), V2(n)) = argmin(n. n) F(Vu V2X EQ. 2 

where F is a similarity fimction defined for adjacent regions in P(n). The minimum value 
^2(w)) is fiirther referred to herein as ^n). 

For an image sub-area of a predefined size and shape, such as an 8x8 pixel 
block, fi-om the image there exists a partition, P(m), m = m{B\ that represents the first 
partition to cover B to the extent of a predefined coverage measure, such as complete 
coverage. It may be seen that larger values of m{B) would indicate that B contains pixels 
from regions of greater contrast that are merged at later stages of the region merging 
procedure, while smaller values of m{B) would indicate that B contains pixels from more 
homogeneous regions of lesser contrast that are merged earlier. A measure C{B) of 
region contrast significance may be expressed in a variety of ways. For example, C{B) 
may be defined as: 

C(5)= m{B). EQ.3 
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Alternatively, C(5) may be defined as the percentage of all image sub-areas in the frame 
that were covered by regions to the extent of a predefined coverage measure, such as 
complete coverage, at the time that block image sub-area B was first covered by a region 
to the same or a different predefined extent. 

C{B) may also be defined such that image sub-areas within the same 
homogeneous image region are assigned similar significance values as follows. A 
similarity measure F may be defined as the absolute difference between the average 
luminance values Y{V) of the regions V comprising the partitions P(w). Initially, for 
adjacent regions Vu V2 in P(l) comprising one pixel each, F may be expressed as: 
F(VuV2) = \Y(V,\Y(V2)l ' EQ.4 

Fig. IB shows a merged region V3 obtained by merging the regions Vi and V2 
in P(n) at an (w+l)-th step in the merging process. The similarity function may be 
defined as follows in EQ. 5. Where Vz is a region in P(n) adjacent to V\ : 

F(V, , F3 ) = {max (F(y, , V, ), F(V, , ), | Y(V, ) « Y(V, )\ifV, is adjacent to V, 
{m^(F(V,,V,),\Y(V,)-Y(V,)\ otherwise 

It may be seen that EQ. 5 ensures that the function (/(n) increases, and that the 
values of ^n) do not exceed the maximal luminance value. This allows the significance 
of image sub-area B to be defined as: 

C(B)=^m(B))/M, EQ.6 
where the maximal luminance value Af= 255. 

The computational cost of the measures C() described hereinabove may be 
reduced as follows. Let Vi = V\(n), V2 = V2{n) denote the regions merged at an n-th step 
of the merging procedure. Define Cov{Vu V2) as the family of the image sub-areas which 
are covered to the extent of a predefined coverage measure, such as complete coverage, 
by the merged regions at the n-th step: 

Cov( , ^2) = {5 1 5 n Fi 9t 0, 5 n F2 ;6 0, 5 c Ki u F2 } EQ. 7 
It is appreciated that the computation of C() may be reduced to the computation of 
Cov(Vu V2) Straightforward computation of the family implies exhaustive enumeration 
of all the pixels of the merged regions for each n. For a large value of N, this essentially 
increases the time-complexity of the computation of CQ- To avoid this, for each region V 
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defined during the merging procedure a family Br(V) of boundary blocks may be defined 
as: 

Br(V)^ {B\BnV:^0mdB^V} EQ. 8 

It may be seen that: 

Cov(Vu V2)^{B\Bg BfiYi) u Br(y2) and 5 £ Ki u Vi) EQ. 9 

and 

BHYi u F^) = {5 1 5 € Br{Vi) u BfiVi) \ Cov{Vu V2)} EQ. 10 

At each n-th step of the merging procedure, the family Cov(Fi, F2) may be obtained using 
EQ. 9, and the family Br may be obtained for a new region Vj u V2 using EQ. 10. This 
allows for the contrast measurements described hereinabove to be performed only upon 
the boimdary blocks between regions, thus making the complexity of the computation of 
CO comparable to the complexity of region merging. 

Reference is now made to Figs. 2A - 2B, 3A - 3B, and 4A - 4B, which are 
sample video fi'ames before and after processing using region merging as described 
hereinabove. 8x8 pixel blocks whose significance exceeds a predefined fi*ame-dependent 
threshold are shown in Figs. 2B, 3B, and 4B, with significance of C{B) > J thresholds of 
7^0.1 (Fig. 2B), 7^126.0 (Fig. 3B), and 7^95.0 (Fig. 4B). 

Reference is now made to Fig. 5, which is a simplified block diagram of a 
video encoder adapted for encoding image sub-areas according to their significance, 
constructed and operative in accordance with a preferred embodiment of the present 
invention. In Fig. 5 a standard video encoder generally designated 500 is shown having a 
region contrast significance (RCS) computation module 502 for computing significance 
of input image sub-areas, such as 8x8 pixel blocks, in accordance with the methods 
described hereinabove. Encoder 500 may be, for example, an MPEG encoder. RCS 
computation module 502 typically receives a raw video fi*ame and computes a 
significance value C{B) for each block B of the fi-ame as described hereinabove. The 
values of C{B) are preferably used by encoder 500 in accordance with predetermined 
criteria to determine whether the image sub-area should undergo enhanced encoding by 
encoder 500. Preferably, encoder 500 gives preference for INTRA-block encoding in P- 
frames to the blocks B with a high significance value C{B). For example, module 502 
may determine that a block of a P-firame having a significance below a predefined 
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threshold should be encoded as fhe difference between the block and a similar block in 
another frame, or encoded as-is as an INTRA block by giving preference in INTRA block 
encoding to the blocks with significance at or above the threshold. This is illustrated in 
Fig. 8 in which two blocks Bl and B2 are shown, where C{B1) is expected to indicate a 
greater significance than C{B2), Block Bl would thus be preferred for INTRA-block 
encoding over block B2. This determination may be used in addition to other 
determination criteria, such as in MPEG-4 where a macroblock is required to be encoded 
in INTRA-refresh mode at some point before it is encoded 132 times as predictive 
macroblock. Preferred methods for selecting image blocks for INTRA-block refresh are 
described in greater detail hereinbelow with reference to Figs. 6 and 7. 

Reference is now made to Fig. 6, which is a simplified flowchart illustration 
of a method for selecting image sub-areas for INTRA encoding according to their 
significance, operative in accordance with a preferred embodiment of the present 
invention. In the method of Fig. 6 , Fr denotes an image or frame, and R=R(Fr) denotes 
the number of predefined image sub-areas B, such as 8x8 pixel blocks, in Fr that an 
encoder will encode in INTRA-mode. A sxmi S of the values of C(B) over all image sub- 
areas B in Fr is computed as 

S = C(B/) + C(B2) + C(B5) C(^x\ 
where X denotes the number of the image sub-areas in frame Fr. A random number q is 
then selected in the segment [0; S] having a uniform distribution. The image sub-area By 
corresponding to q in the sequence 

SEQ = B/, B2, B5, . . . Ba' 
is then found where v is a number such that: 

C(B/) + C(B2) + C(Bj) C(B V-/) is less or equal to q, and 

CCBy) + CiBi) + C(B5) +..._+ C(B v-7) + C(B v) is greater then q. 
It may be seen that the larger the value of C(B), the greater the chance that q will fall to 
the "bin" C(B). The image sub-area By is the first image sub-area in frame Fr selected for 
encoding in INTRA-mode. After the selection of By, the image sub-area is removed from 
the sequence SEQ, the sum S decreases by C(Bv), and the procedure is repeated for the 
selection of the second image sub-area, and so on. 
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Reference is now made to Fig. 7, which is a simplified flowchart illustration 
of a method for selecting image sub-areas for INTRA encoding according to their 
significance, operative in accordance with a preferred embodiment of the present 
invention. In the method of Fig. 7, an image or video fi-ame is segmented using any 
conventional technique into A/^ regions to form a partition RS = Rj, R2,Rs, ** , Rn- Image 
sub-areas B in RS^ being of a predefined size and shape, such as 8x8 pixel blocks, are 
examined to determine whether B contains pixels firom difiTerent regions of RS. A sub- 
area B containing pixels firom different regions from RS is assigned a larger value of C(B) 
relative to a sub-area B which lay completely in a region Rt in RS. For example, 8x8 
pixel blocks B which lay completely in a region Ri in RS may be assigned a significance 
value C(B) = 0, whereas 8x8 pixels blocks B which contain pixels from different regions 
in RS may be assigned a significance value C(B) = 1. Blocks B with a greater C(B) may 
then be given preference over blocks having a lower C(B) for selection for INTRA-block 
encoding. 

Reference is now made to Fig. 9, which is a simplified block diagram of a 
video encoder adapted for encoding image sub-areas according to their significance, 
constructed and operative in accordance with a preferred embodiment of the present 
invention. In Fig. 9 a standard video encoder generally designated 900 is shown having 
an RCS computation module 902 for computing the significance of input image sub- 
areas, such as 8x8 pixel blocks, in accordance with the methods described hereinabove. 
Encoder 900 may be, for example, an MPEG-2 encoder. RCS computation module 902 
typically receives a raw video frame and computes a significance value C(B) for each 
block B of the frame. The values of C(B) are preferably used by encoder 700 in 
accordance with predefined criteria to determine whether the block should undergo 
enhanced encoding by encoder 900. For example, module 902 may determine that a 
block having a significance value that is above a predefined threshold should be encoded 
with a lesser value of MQUANT relative to a block having significance value that is 
below the predefined threshold. A preferred method for selecting image blocks for lower 
MQUANT encoding is described in greater detail hereinbelow with reference to Fig. 10. 
Altematively, module 902 may determine that the scanning of the DCT coefficients^may 
be curtailed for a block having a significance value that is below a predefined threshold. 
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A preferred method for scanning the DCT coefficients of image sub-areas during 
encoding is described in greater detail hereinbelow with reference to Fig. 1 1 . 

Reference is now made to Fig. 10, which is a simplified flowchart illustration 
of a method for encoding image sub-areas according to their significance, operative in 
accordance with a preferred embodiment of the present invention. In the method of Fig. 
10 the significance measure C(B) of an image sub-area B may be xxsed to regulate the 
quantization process in image/video compression in such a way that the DCT coefficients 
of image sub-areas B with higher values of C(B) will be quantized using lower quantizer 
values relative to the DCT coefficients of image sub-areas B with lower values of C(B). 
For example, in the MPEG-2 video standard, such regulation may be done for 
macroblocks B via adjustment of the MQUANT parameter at the macroblock level as 
follows: 

MQUANT(B) = MQUANT i - ^ * C(B), 
where MQUANT(B) is the MQUANT value for a macroblock B. MQUANT i is a 
quantization threshold and A: is a scaling factor, both of which are image-dependent 
parameters that may be set by the user and/or using any conventional technique. In the 
MPEG-4 video standard, such regulation may be similarly performed via adjustment of 
the DQUANT parameter at the macroblock level. 

Reference is now made to Fig. 11, which is a simplified pictorial illustration 
of a method for scanning the DCT coefficients of image sub-areas in JPEG/MPEG 
image/video compression according to their significance, operative in accordance with a 
preferred embodiment of the present invention. In Fig. 11, for predefined image sub- 
areas B^ such as 8x8 pixel blocks, in an image processed using region merging as 
described hereinabove, the scanning of the DCT coefficients,may be stopped when L{B) 
elements have been processed, where 

where T is a significance threshold and A: is a scaling factor, both of which are image- 
dependent parameters that may be set by the user or using any conventional technique. 
This reduces the high firequency DCT data for the blocks having a low C(B) value, and 
thus provides relative enhancement for the blocks with high significance. 
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It is appreciated that one or more of the steps of any of the methods described 
herein may be omitted or carried out in a different order than that shown, without 
departing from the true spirit and scope of the invention. 

While the methods and apparatus disclosed herein may or may not have been 
described with reference to specific computer hardware or software, it is appreciated that 
the methods and apparatus described herein may be readily implemented in computer 
hardware or software using conventional techniques. 

While the present invention has been described with reference to one or more 
specific embodiments, the description is intended to be illustrative of the invention as a 
whole and is not to be construed as limiting the invention to the embodiments shown. It is 
appreciated that various modifications may occur to those skilled in the art that, while not 
specifically shown herein, are nevertheless within the true spirit and scope of the 
invention. 
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